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MULTICHANNEL SPECTRAL MAPPING AUDIO 
APPARATUS AND METHOD 

BACKGROUND OF THE INVENTION 
Field of the Invention 

This invention relates to multichannel audio systems 
and methods, and more particularly to an apparatus and 
method for deriving multichannel audio signals from a mon- 
aural or stereo audio signal. 

Description of the Related Art 

Monaural sound was the original audio recording and 
playback method invented by Edison in 1877. This method 
was subsequently replaced by stereo or two channel record- 
ing and playback, which has become the standard audio pre- 
sentation format. Stereo provided a broader canvas on 
which to paint an audio experience. Now it has been recog- 
nized that audio presentation in more than two channels can 
provide an even broader canvas for painting audio experi- 
ences. The exploitation of multichannel presentation has 
taken two routes. The most direct and obvious has been to 
simply provide more record and playback channels directly; 
the other has been to provide various matrix methods which 
create multiple channels, usually from a stereo (two chan- 
nel) recording. The first method requires more recording 
channels and hence bandwidth or storage capacity. This is 
generally not available because of intrinsic bandwidth or 
data rate limitations of existing distribution means. For 
digital audio representations, data compression methods can 


reduce the amount of data required to represent audio sig- 
nals and hence make it more practical, but these methods 
are incompatible with normal stereo presentation and cur- 
rent hardware and software formats. 

Matrix methods are described in Dressier, "Dolby Pro 
Logic Surround Decoder - Principles of Operation" (http:- 
//www. dolby . com/ht/ds&pl/whtppr .html) ; Waller, Jr., "The 
Circle Surround® Audio Surround Systems", Rocktron Corp. 
White Paper; and in Patent Nos . 3,746,792, 3,959,590, 
5,319,713 and 5,333,201. While matrix methods are reason- 
ably compatible with existing stereo hardware and software, 
they compromise the performance of the stereo or multichan- 
nel presentations, or both, their multichannel performance 
is severely limited compared to a true discrete multichan- 
nel presentation, and the matrixing is generally uncon- 
trolled . 

SUMMARY OF THE INVENTION 

The present invention addresses these shortcomings 
with a method and apparatus which provide an uncompromised 
stereo presentation as well as a controlled multichannel 
presentation in a single compatible signal. The invention 
can be used to provide a multichannel presentation from a 
monaural recording, and includes a spectral mapping tech- 
nique that reduces the' data rates needed for multichannel 
audio recording and transmission. 

These advantages are achieved by sending along with a 
normally presented "carrier" audio signal, such as a normal 
stereo signal, a spectral mapping data stream. The data 
stream comprises time varying coefficients which direct the 
spectral components of the "carrier" audio signal or sig- 
nals to multichannel outputs. 

During multichannel playback, the invention preferably 
first decomposes the input audio signal into a set of spec- 
tral band components. The spectral decomposition may be 


the format in which the signals are actually recorded or 
transmitted for some digital audio compression methods and 
for systems designed specifically to utilize this inven- 
tion. An additional separate data stream is sent along, 
with the audio data, consisting of a set of coefficients 
which are used to direct energy from each spectral band of 
the input signal or signals to the corresponding spectral 
bands of each of the output channels. The data stream is 
carried in the lower order bits of the digital input audio 
signal, which has enough bits that the use of lower order 
bits for the data stream does not noticeably affect the 
audio quality. The time varying coefficients are indepen- 
dent of the input audio signal, since they are defined in 
the encoding process. The "carrier" signal is thus sub- 
stantially unaffected by the process, yet the multichannel 
distribution of the signal is under the complete control of 
the encoder via the spectral mapping data stream. The co- 
efficients can be represented by vectors whose amplitudes 
and orientations define the allocation of the input audio 
signal among the multiple output channels. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a block diagram of a digital signal proces- 
sor (DSP) implementation of the invention's multichannel 
spectral mapping (MSM) ' decoder; 

FIG. 2 is a block diagram illustrating the DSP multi- 
channel spectral mapping algorithm structure; 

FIG. 3 is a set of signal waveforms illustrating che 
use of aperture functions to obtain discrete transform rep- 
resentations of continuous signals; 

FIG. 4 is a block diagram of a DSP implementation of 
a method for calculating the spectral mapping coefficients 
in the encoding process; 

FIG. 5 is a block diagram illustrating the spectral 
mapping coefficient generating algorithm; 


FIG. 6 is a block diagram illustrating a vector tech- 
nique for representing the mapping coefficients; 

FIG. 7 is a diagram illustrating the use of the vector 
technique with decoder lookup tables; and 

FIG. 8 is a diagram illustrating a fractional least 
significant bit method for encoding an audio signal with 
mapping coefficients. 

DETAILED DESCRIPTION OF THE INVENTION 

A simplified functional block diagram of a DSP imple- 
mentation of a decoder that can be used by the invention is 
shown in FIG. 1. A "carrier" audio signal, which may be 
monaural or stereo for example, is input to an analog- to- 
digital (A-D) converter and multiplexer 2 via input lines 
1. For simplicity singular term "signal" is used to in- 
clude a composite of multiple input signals. In some ap- 
plications the audio signal will already be in a multi- 
plexed digital (PCM) representation and the A-D multiplexer 
will not be needed. The digital output of the A-D multi- 
plexer is passed via line 3 to the DSP 5, where the signal 
is broken into a set of spectral bands in the spectral de- 
composition algorithm 4, and sent to a spectral mapping 
function algorithm 6. The spectral bands are preferably 
the conventional critical (bark) bands, which have a rough- 
ly constant bandwidth of about 100 Hz for frequencies below 
500 Hz, and a bandwidth that increases with' frequency for 
higher frequencies (roughly logarithmically above 1 kHz) . 
Critical bands are discussed in O' Shaughnessy , Speech Com- 
munication - Human and Machine. Addison-Wesley , 1987, pages 
148-153 . 

The spectral mapping function algorithm 6 directs the 
input signals in each of the bands from each of the input 
channels to corresponding bands of each of the output chan- 
nels as directed by spectral mapping coefficients (SMCs) 
delivered from a spectral mapping coefficient formatter 7. 
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The SMC data is input to the DSP 5 via a separate input 11. 
The multiplexed resultant digital audio output signals are 
passed over a line 8 to a demultiplexer digital-to-analog 
(D-A) converter 9, where they are converted into multichan- 
5 nel analog audio outputs applied to output lines 10, one 
for each channel . 

The input signals can be broken into spectral bands in 
the spectral decomposition algorithm by any of a number of 
well know methods. One method is by a simple discrete 
10 Fourier transform. Efficient algorithms for performing the 
discrete Fourier transform are well known, and the decompo- 
sition is in a form readily useable for this invention. 
However, other common spectral decomposition methods such 
as multiband digital filter banks may also be used. In the 
15 case of the discrete Fourier transform decomposition, some 
transform components may be grouped together -and controlled 
by a single SMC so that the number of spectral bands uti- 
lized by the invention need not equal the number of compo- 
nents in the discrete Fourier transform representation or 
other base spectral representation. 

A more detailed block diagram of the DSP multichannel 
spectral mapping algorithm 6, along with the spectral de- 
composition algorithm 4, is shown in FIG. 2. The signal 
"lines" in the drawing indicate information paths in the 
implementing DSP algorithm, while the multiply and sum 
function blocks indicate operations in the DSP algorithm 
that implement the spectral mapping aspect of the inven- 
tion. This functional block diagram is shown only to de- 
scribe the DSP implementation algorithm. Although the in- 
vention could in principle be implemented with separate 
multiply and add components as indicated in the drawing, 
that is not the intent implied by this explanatory figure. 

Respective spectral decomposition algorithms 22 and 23 
are provided for each input channel. For a standard stereo 
input consisting of left and right input signals respec- 
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tively on input lines 20 and 21, left and right algorithms 
are provided; there is only one algorithm for a monaural 
input. Each spectral decomposition algorithm produces in- 
puts to the spectral mapping algorithm within M spectral 
5 bands on corresponding lines 24, 25... for algorithm 22, 
and lines 26... for algorithm 23. The algorithms prefera- 
bly operate on a multiplexed basis in synchronism with the 
multiplexed output of multiplexer 2 in FIG. 1, but are 
shown in FIG. 2 as separate blocks for ease of understand- 
10 ing. 

The input frequency bands produced by the spectral 
decomposition algorithms are designated by the letter F 
followed by two subscripts, with the first subscript stand- 
ing for the input channel and the second subscript for the 
15 frequency band within that channel. A separate SMC, desig- 
nated by the letter a , is provided for each frequency band 
of each input channel for mapping onto each output channel, 
with the first subscript after a indicating the correspond- 
ing input source channel, the second subscript the output 
target channel, and the third subscript the frequency band. 
The input frequency band Fl,l on line 24 is multiplied in 
multiplier 28 by a SMC a,_^ , from the spectral mapping coef- 
ficient formatting algorithm 7 of FIG. 1, and passed to a 
summer 29 for the first output channel, where it is accumu- 
lated with the products of all the other input frequency 
bands multiplied by their respective SMCs for the first 
output channel. Specifically, the other input components 
F1,2...F1,M ... FR,1 FR,2 ...FR,M (for R input channels) 
are multiplied by their respective SMCs «^ ^ ^ • • ■ «i i m • • ■ i j 

"r-1,2 • ■ • «R,i,M' to produce a first channel output 30. This 
process is duplicated for all spectral bands of all input 
and output channels as indicated in the figure, in which 
the multipliers, summer and output for output channel 2 are 
respectively indicated by reference numbers 31, 32 and 33, 
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and the multipliers, summer and output for output channel 
N are respectively indicated by 34, 35 and 36. 

From FIG. 2 the multichannel output signals are given 
by the following equations: 


R M 
i u-i L.=l 


where: Oj^{t) = the output of channel K at time t. 

"j,K,L,T = the SMC of input channel J' s Lth spectral 

band component in time aperture period T onto output chan- 
nel K. 

= The Jth input channel's Lth spectral band 
signal at time t from aperture window T. 

There are R input channels, M spectral bands in the 
decomposition of each input signal and N output channels. 
In the example given, at any particular time t there will 
be contributions to the output signal from components from 
one or two overlapping transform windows. T is the sub- 
script indicating a particular transform window. The mul- 
tiply and add operations described in the invention can be 
carried out on one of more DSPs, such as a Motorola 5600 0 
20 series DSP. 

In some applications, particularly those in which the 
input digital audio signal has been digitally compressed, 
the signal may be delivered to the playback system in a 
spectrally decomposed form and can be applied directly to 
the spectral mapping subsystem of the invention with simple 
grouping into appropriate bands. A good spectral decompo- 
sition is one that matches the spectral masking properties 
of the human hearing system like the so called "critical 
band" or "bark" band decomposition. The duration of the 
weighing function, and hence the update rate of the SMCs, 
should accommodate the temporal masking behavior of human 
hearing. A standard 24 "critical band" decomposition with 
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5-20 millisecond SMC update is very effective in the pres- 
ent invention. Fewer bands and a slower SMC update rate is 
still very effective when lower rates of spectral mapping 
data are required. Update rates can be as slow as .1 to .2 
seconds, or even constant SCMs can be used. 

FIG. 3 illustrates the role of temporal aperture func- 
tions in the spectral decomposition of an audio signal and 
the relationship of the decomposition to the SMCs illus- 
trated in FIGs. 1 and 2. An audio signal 40 is multiplied 
by generally bell curve shaped aperture functions 41, 42, 
43... to produce the bounded signal packets 44, 45, 46... 
before performing the discrete Fourier transform on the 
resultant "apertured" packets. The aperture function 41 
increases from zero at a time t = l to unity and then back to 
zero over a period T that ends at time t=3 . Aperture func- 
tions 42 and 43 have similar shapes, with function 42 span- 
ning a second period T between t=2 and t=4, and function 43 
spanning a third period T between t=3 and t=5 . Each suc- 
cessive aperture function preferably begins at the midpoint 
of the immediately preceding aperture period. This process 
provides for artifact free recomposition of the signal from 
the resultant multiple transform representation and pro- 
vides a natural time frame for the SMCs, Aperturing is the 
standard signal processing technique used in the discrete 
spectral transformation of continuous signals. 

A set of SMCs can be provided for each transformed 
signal packet such as 44. These coefficients describe how 
much of each spectral component in the signal packet is 
directed to each of the output signal channels for that 
aperture period. In FIG. 2 the input signal is shown de- 
composed into frequency bands Fl, F2,...,FM. The SMC is 
the fraction of the signal level in band L directed from 
the input J to output K for aperture period T. A complete 
set of coefficients define the distribution of the signals 
in all the spectral bands in a given T aperture period, A 


new set of SMCs are provided for the next overlapping aper- 
ture period, and so on. The total signal at any point in 
time on a given output channel will thus be the sum of the 
SMCs directing signal components from the overlapping spec- 
tral decompositions periods of the input "carrier" signal 
or signals. 

The signal level in each frequency band ultimately 
represents the signal energy in that band. The energy lev- 
el can be expressed in several different ways. The energy 
level can be used directly, or the signal amplitude of the 
Fourier transform can be used, with or without the phase 
component (energy is proportional to the square of the 
transform amplitude) . The sine or cosine of the transform 
could also be used, but this is not preferred because of 
the possibility of dividing by zero when the transform is 
non-zero , 

The frequency bands of the spectral decomposition of 
the signal are best selected to be compatible with the 
spectral and temporal masking characteristics of human 
hearing, as mentioned above. This can be achieved by ap- 
propriate grouping of discrete Fourier spectral components 
in "critical band" -like groups and using a single SMC con- 
trol of all components grouped in a single band. Alterna- 
tively, conventional multiband digital filters may be used 
to perform the same function. The temporal resolution or 
update rate of the SMCs is ultimately limited to multiples 
of the time between the transform aperture functions illus- 
trated in FIG. 3. For example, if the interval between 
time 1 and time 3 comprises 1000 PCM samples, providing a 
1000 point discrete Fourier transform, the minimum time 
between updates of SMCs would be one-half that period or 
500 PCM samples. In the case of a conventional digical 
audio sample race of 48,000 samples per second, this is a 
period of 10.4 milliseconds. 

One method for generating the SMCs in the encoding 
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process is shown in the DSP algorithm functional block dia- 
gram of FIG. 4. Once generated, the SMCs are carried along 
with the standard stereo (or monaural) digital audio signal 
in the desired medium, such as a compact disk, tape br ra- 
dio broadcast, formatted by the SMC formatting algorithm 6 
at the player or receiver, and used to control the mapping 
of the original stereo or monaural signal onto the multi- 
track output from the decoder DSP 6 . 

An important feature of the invention relates to how 
the SMCs are generated in a conventional sound mixing pro- 
cess. One implementation proceeds as follows. Given the 
same master source material used to produce the basic ste- 
reo or mono "carrier" recording, which is usually a multi- 
track source 4 8 of 24 or more tracks, one produces a second 
"guide" mix in the desired multichannel output format. 
Separate level adjusters 50 and equalizers 52 are provided 
for each track. During the multichannel "guide" mix, the 
level and equalization of the master source tracks are 
maintained the same as in the stereo mix, but are panned or 
"positioned" to produce the desired multichannel mix using 
a multichannel panner 54 which directs different amounts of 
the source tracks to different "guide" or target channels 
(five guide channels are illustrated in FIG. 4) . A sepa- 
rate panner 56 distributes the level adjusted and equalized 
track signals among the" "carrier" or input source channels 
(stereo carrier channels are illustrated in FIG. 4) . 

The SMCs are derived by spectrally decomposing both 
the stereo carrier signals and the multichannel guide sig- 
nals, and calculating the ratios of the signals in each 
output channel's spectral bands compared to the signal in 
the corresponding input "carrier" spectral bands. This 
procedure assures that the spectral makeup of the output 
channels corresponds to that of the "guide" multichannel 
mix. The calculated ratios are the SMCs required to attain 
35 this desired result. The SMC derivation algorithm can be 
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implemented on a standard DSP platform. 

The "guide" multichannel mix is delivered from panner 
54 to an A-D multiplexer 58, and acts as a guide for deter- 
mining the SMCs in the encoding process. The encoder de- 
termines the SMCs that will match the spectral content of 
the decoder's multichannel output to the spectral content 
of the multichannel "guide" mix. The "carrier" audio sig- 
nal is input from panner 56 to an A-D multiplexer 60. The 
digital outputs from A-D multiplexers 58 and 60 are input 
to a DSP 62. Rather than the two A-D multiplexers shown 
for functional illustration, a single A-D multiplexer is 
generally used to convert and multiplex all "carrier" and 
"guide" signals into a single data stream to the DSP. The 
"carrier" and "guide" functions are shown separately in the 
figure for clarity of explanation. 

The "guide" and "carrier" digital audio signals are 
broken into the same spectral bands as described above for 
the decoder by respective spectral decomposition algorithms 
64 and 66. The level of the signal in each band of each 
input multichannel "guide" signal is divided by the level 
of each of the signals in the corresponding band of the 
"carrier" signal by a spectral band level ratio algorithm 
6 8 to determine the value of the corresponding SMC. For 
example, the ratio of the signal level in band 6 of target 
channel 3 to the signal level of band 6 of carrier input 
channel 2 is SMC 2,3,6, Thus, if there are five channels 
in the "guide" multichannel mix and two channels (stereo) 
in the "carrier" mix, and the signals are each broken into 
ten spectral bands, a total of 100 SMCs would be calculated 
for each transform or aperture period. The calculated co- 
efficients are formatted by an SMC formatter 70 and output 
on line 72 as the spectral mapping data stream used by the 
decoder . 

The SMCs generated using the above method may be used 
directly in implementing the invention or they may be modi- 
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fied using various software authoring tools, in which case 
they can serve as a starting or first approximation of the 
final SMC data. 

Alternatively, entirely new sets of coefficients may 
be produced to effect any desired multichannel distribution 
of the "carrier" signal. For example, any input signal can 
be directed to any output channel by simply setting all 
SMCs for that input to that output to 1 and all SMCs for 
that input to other channels to 0. Another feature which 
the SMCs may have is an added time or phase delay component 
to provide an added dimension of control in the multichan- 
nel output configuration derived from the "carrier" signal. 

Conventional stereo matrix encoding can also be used 
in conjunction with the current invention to enhance the 
15 multichannel presentation obtained using the method. To do 
this the phases of the spectral band audio components of 
the "carrier" audio can be manipulated in the recording 
process to increase the separation and discreetness of the 
final multichannel output. In some cases this can reduce 
the amount of SMC data required to attain a given level of 
performance . 

The coefficients in the SMC matrix need not be updated 
for every new transform period, and some of the coeffi- 
cients may be set to always be 0. For example, the system 
may arbitrarily not allow signal from a left stereo input 
to appear on the right multichannel output, or the required 
rate of change of the low frequency band SMCs may not need 
to be as high as the rate for the upper frequency bands. 
Such restrictions can be used to reduce the' amount of in- 
formation required to be transmitted in the SMC data 
stream. In addition, other conventional data reduction 
methods may also be used to reduce the amount of data need- 
ed to represent the SMC data. 

FIG. 5 illustrates in more detail the operation of 
encoder DSP 62 for the case of stereo input channels. As 
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with the decoder algorithms, functions that are preferably 
performed by single algorithms on a multiplexed basis are 
illustrated as equivalent separate functions for ease of 
understanding. The input audio signal on the input stereo 
channels are spectrally decomposed by spectral decomposi- 
tion algorithms 66-1 and 66-2 into respective frequency 
bands F^^^, , .F^,^^ and F2,i • • • ^2^^^, while the guide signals on 
the desired N number of output channels are spectrally de- 
composed by spectral decomposition algorithms 64-1 through 
64-N into respective frequency bands Fi^^, . , . F.^^^ through F^^^_ 
. , .Fn,m that correspond to the input channel frequency bands. 
A set of dividers 74 (equal in number to 2xNxM) compare the 
signal level within each band of each input channel with 
the signal level within the corresponding bands of each of 
the output channels, by ratioing the two signal levels, to 
generate a set of SMCs that represent the ratios of the 
band-based output -to- input signal levels. Separate SMCs 
are obtained from each divider, and used at the decode end 
to map the input signals onto the output .channels as de- 
scribed above. 

Another important technique to reduce the amount of 
data required to be transmitted for the SMCs and to gener- 
alize the representation in a way that allows playback in 
a number of different formats is to not send the actual 
SMCs, but rather spectral component lookup address data 
from which the coefficients may be readily derived. In the 
case of the playback speakers arranged in three dimensions 
around the listener, only a 3 -dimensional address of a giv- 
en spectral component needs to be specified; this requires 
only three numbers. In the case of playback speakers ar- 
ranged in a plane around the listener, only a 2 -dimensional 
address of a given spectral component needs to be speci- 
fied; this requires only two numbers. The translation of 
a 2 or 3 -dimensional address into the SMCs for more or even 
fewer channels can be easily accomplished using a simple 
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table lookup procedure, A conventional lookup table can be 
employed, or less desirably an algorithm could be entered 
for each different set of address data to generate the de- 
sired SMCs. For purposes of the invention an algorithm of 
this type is considered a form of lookup table, since it 
generates a unique set of coefficients for each different 
set of input address data. 

Different addressable points in the address space 
would have different associated entries in the lookup ta- 
ble, or the SMCs may be generated by simple linear interpo- 
lation from the nearest entries in the table to conserve on 
table size. Formatting of the SMCs as sets of address num- 
bers would be accomplished in the SMC formatter 64 of FIG. 
4, while the lookup table at the decoder end would be em- 
bedded in the SMC formatter G of FIG. 1. 

The concept is illustrated in FIG. 6, in which four 
speakers 76, 78, 80 and 82 are all arranged in a common 
plane. A central vector arrow 84, which is shown pointing 
to a location between speakers 80 and 82 but closer to 
speaker 82, indicates the emphasis to be given to each of 
the speakers for a particular aperture time period and fre- 
quency band. Vector 84 is slightly greater than normal to 
a line from speaker 76, and generally points away from 
speaker 78. Thus, the SMCs for the decoder output for 
speaker 82 will be greater than for the other speakers, 
followed by progressively reduced SMC values for speakers 
8, 76 and 78, in that order. If during the next aperture 
time period the output from speaker 76 is to be emphasized 
over the other speakers for the same frequency band, vector 
84 will "point" toward speaker 76 and the SMCs for each of 
the speakers are adjusted accordingly, with the highest 
value SMCs for the band now assigned to speaker 76 . 

Taking the vector analogy a step further, the absolute 
amount of emphasis to be given to each speaker, as opposed 
to simply the desired direction of the emphasis, can also 


be given by vector 84. For example, the vector direction 
or orientation could be chosen to indicate the sound direc- 
tion, and the vector amplitude the desired level of empha- 
sis . 

FIG. 7 illustrates a mapping of different vectors 84a, 
84b, 84c onto different lookup table addresses 86 that 
would be stored in the SMC formatting algorithm 7 of FIG. 
1. Each address 86 stores a unique combination of SMCs . 
A complementary set of lookup table addresses is implement- 
ed in the encoder formatting algorithm 70 of FIG. 4 to gen- 
erate the vectors from the originally calculated SMCs; 
these SMCs are restored from the vectors by lookup table 
addresses 86. Each address stores a set of coefficients 
that are equal in number to the number of input channels 
multiplied by the number of output channels. For example, 
with a stereo input and a five-channel output, each address 
would store ten SMCs, one for each input -output channel 
combination. Alternately, a separate lookup table could be 
provided for each stereo input channel, in which case each 
address would need to store only five SMCs. A separate 
vector is employed for each different frequency band, and 
the SMCs for a given output channel accumulated over all 
bands . 

Since the particular address 86 used at any given time 
depends on both the vector amplitude and angle, it is not 
necessary that the vector amplitude correspond strictly to 
the degree of emphasis and the vector angle to the direc - 
tion of emphasis. Rather, it is the unique combination of 
the vector amplitude and angle that determines which lookup 
address is used, and thus what degree of emphasis is allo- 
cated to the various output channels for each aperture pe- 
riod and frequency band. 

The spectral address data that describes vector 84 re- 
quires only two numbers. For example, a polar coordinate 
system could be used in which one number describes the 


vector's polar angle and the other its direction. Alter- 
nately, an x,y grid coordinate system could be used. The 
vector concept is easily expandable to three dimensions, in 
which case a third number would be used for the elevation 
of the vector tip relative to its opposite end. Each dif- 
ferent combination of vector amplitude and direction maps 
to a different address in the lookup table. 

This spectral address representation is also important 
because it allows the input signal to be played back in 
various playback channel configurations by simply using 
different lookup tables for the SMCs for different speaker 
configurations. A separate 2-D or 3-D vector- to-SMC lookup 
table could be used to map for each different playback con- 
figuration. For example, four- speaker and six- speaker sys- 
tems could be operated from the same compact disk or other 
audio medium, the only difference being that the four- 
speaker system would include a lookup table that translated 
the vector address data into four output channels, while 
the six- speaker system would include a lookup table that 
translated the address data into six output channels. The 
difference would be in the design of a single IC chip at 
the decoder end. In the 3-D audio case, having proper 
phase information in the stereo "carrier" signal is impor- 
tant. Other characteristics of the particular playback 
environment, such as the spectral response of particular 
speakers or environments, can also be accounted for in the 
"position" -to-SMC lookup tables. 

The most direct way to implement the lookup table is 
to have each different lookup address provide the absolute 
values of the SMCs that relate each input channel to each 
output channel. Alternately, the active matrix approach of 
the present invention could be superimposed on a prior pas- 
sive matrix approach, such as the Dolby or Rocktron tech- 
niques mentioned previously. For example, a fixed (pas- 
sive) coefficient could be assigned to each input-outpuu 


channel pair for each frequency band on a predetermined ba- 
sis, which could be equal passive coefficients for each 
input -output pair. Respective active SMCs generated in 
accordance with the invention would then be added to the 
passive coefficients for the various input-output pairs. 

The present invention may be used to make so-called 
compatible CDs, in which the CD contains a conventional 
stereo recording playable on conventional CD players. How- 
ever, lower order bits, preferably only a fraction of the 
least significant bit (LSB) of the conventional digital 
sample words of the signal, are used to carry the SMCs for 
a multichannel playback , This is called a fractional LSB 
method of implementing the invention* 1/4 of a LSB, for 
example, means that for every fourth signal sample the LSB 
is in fact an SMC data bit. At conventional stereo digital 
audio PCM sample rates of 48,000 samples per second this 
yields over 24,000 bits per second to define the SMCs 
(12,000 bits per second per stereo channel), while having 
an inaudible effect on the stereo audio signal. For a con- 
ventional 16 bit CD the audio resolution would be 15.75 
bits per sample instead of 16 bits, but this is an inaudi- 
ble difference. In some circumstances the other LSBs can 
be adjusted to spectrally shift any residual noise to hide 
it within a spectrally masking part of the audio spectrum; 
this kind of noise shaping is well known to those skilled 
in the art of digital signal processing. The fractional 
LSB method can be used to implement the invention on any 
digital audio medium, such as DAT (digital audio tape) . A 
unique key code can be included in the fractional LSB data 
stream to identify the presence of the SMC data stream so 
that playback equipment incorporating the present invention 
would automatically respond . 

The fractional LSB approach is illustrated in FIG. 8. 
Audio data from the encoder formatter 70 is transferred 
onto a digital audio medium, for example a compact disk 88, 
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as multibit serial digital sample words 90, typically 16 
bits per word at present. The encode DSP 55 encodes suc- 
cessive bits of the multibit SMCs onto the LSBs of selected 
sample words, preferably every fourth word, via output line 
72 . . The sample word bits that are allocated to the SMCs 
are indicated by hatching and reference number 92 . The SMC 
bits 92 are applied to the decode DSP 5 via its input 11, 

The invention can also be used with an FM radio broad- 
cast as the digital medium. In this case the SMC data is 
carried on a standard digital FM supplementary carrier. 
The FM audio signal is spectrally decomposed in the receiv- 
er and the invention implemented as described above . CDs 
made with the invention can be conveniently used as the 
saurce for such broadcasts, with the fractional LSB SMC 
data stream stripped from the CD and sent on the supplemen- 
tary FM carrier with the stereo audio signal sent as the 
usual FM broadcast. The invention can be used in other 
applications such as VHS video, in which case the "carrier" 
stereo signal is recorded as the conventional analog or VHS 
HiFi audio signal and the SMC data stream is recorded in 
the vertical or horizontal blanking period. Alternatively, 
if the "carrier" audio can be recorded on the VHS HiFi 
channel, the SMC data stream can be encoded onto one of the 
conventional analog audio tracks. 

In general the invention can be used with mono, stereo 
or multichannel audio inputs as the "carrier" signal or 
signals, and can map that audio onto any number of output 
channels. The invention can be viewed as a general purpose 
method for recasting an audio format in one channel config- 
uration into another audio format with a different channel 
configuration. While the number of input channels will 
most commonly be different from the number of output chan- 
nels, they could be equal as when an input two-channel ste- 
reo signal is reformatted into a two-channel binaural out- 
put signal suitable for headphones. The invention can also 


be used to convert an input monaural signal into an output 
stereo signal, or even vice versa if desired. 

While several embodiments of the invention have been 
shown and described, numerous variations and alternate em- 
bodiments will occur to those skilled in the art. It is 
therefore intended that the invention be limited only in 
terms of the appended claims . 


